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psychological and social factors relevant to children’s speech were 
drawn from the words in the samples. A group Of school psychologists 
then independently placed each sample word into its appropriate 
category to form a content analysis dictionary. Subsequent computer 
content analysis of data agreed closely with the content analysis 
performed by a kindergarten teacher. Computer - content analysis__of sex 
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personality differences in boys and girls. It was concluded that 
computer analysis of psychosocial factors in the language of young* 
children is a quick, efficient way to gather information that was 
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this document is a paper which describes the development of the 
analysis technique used in the language study and contains the data 
and implications of the project. (MH) 
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The measurement of academic achievement of young children is a part-. 

iculur problem for educators » For children who can read, achievement can 

* 

c • 

be evaluated by group icsts. But, individualized achievement tests arc usually 
required for non-readers. These tests ^ uire the administration and scoring 
skills of highly trained examiners - wi. o fees are often expensive. In addi- 
tion to the expense, achievement tests for pre-readers frequently yield highly 

• - 

subjective measurements. 

The trend to place children in school at an early age has aggravated the 

problem of evaluating the child's progress in the early years. Since the child 

\ 

cannot yet read or write, all measurements, either academic or personal and . 
psychological, ar^ of necessity individualized. 

The major channel through which a pre-school child communicates is 

oral language. If his achievement in attaining both cognitive and non-cognitive 

! 

« | 

goal/; of curricula is to be assessed, it must be through thij> means of communi- 

f 

cation. Ideally, this could be done with* a minimum of expense and a maximum 
of objectivity, reliability, and validity. It is hoped that the present study 

i 

offers a technique by which this means of assessment could be implemented. 

4 

The investigator conducted an inquiry into the nature of the psychologi- 

.* * a 

cal and social factors in oral language as an initial step in the development ( 
of an instrument to measure the change of psychological and social factors 
in groups of children. The technique could also be used to evaluate the effec- 
tiveness of pre-school programs designed to bring about changes in behavior 

. tl t 

indicated by these factors. The assumption that verbal behavior indicates in- 
ternal psychological conditions is based on previous research in the content' 



L 



analysis of oral language! (Weintraub & Aronson, 1 9 G2) ? 



Subjects 



The sample for this study was a transcription 'of a tope recording of the 
oral language of 81 boys and 63 girls randomly selected from the kindergarten 
population of Ithaca, New York, in the fall of 1968. 

• i ' • 

Procedures 

4 •» 

t 

A male interviewer recorded an oral language sample for each subject in 

a standardized situation. An abstract block and a toy fire engine were iised 

as stimuli to elicit verbal responses from the children. The child was asked 

t 

to tell the examiner everything he could about the stimulus. If the child failed 
to 1 respond, a series of standardized questions was asked in a specific order. 

The 144 interviews were transcribed, and all* the different words used 
by the children were listed out of context. In the first phase of the analysis, 

l 

the investigator and each of four psychologists examined the list of words in 

4 

t 

relation to content analysis categories from the Harvard III Psychosociological 
Dictionary (Stone et al . , 1966) and independently chose categories they con- 

. 1 , «"» K'* 

• ' 

sidcred appropriate for analysis of children's language . The 26 categories 
listed in Table 1 (numbers 1 to 26) were selected because, they promised to pro- 

t 

vide useful information about the expression of psychological and social variables 
in the language of children. 






(Insert Table 1 About Here) 

Ten New York City school, psychologists , who volunteered for the study 
because of their interest in children's language, participated in the second 



ERIC 

hfflinaffamiaaa 



4 



3 




Table 1 

, 



The Relative frequencies and Psychological and Social Tags ' 





Tag 


f-Boys 


Index No. 


f- Girls 


No. of Words 
Possessing 
a Tag 


1 


neutral word 


. 3872 


1.6 


2371 


249 


2 


aggression 


58 


6.5 


9 


* 20 


3 


a passive state 


1 


- 


0 


1 


4 


self, (egocentric) 


325 


. 1.9 


165 


19 


5 


other people 


457 


1.7 


263 


16 


6 


the future 


o. 


- 


4 


} 


7 


physical and bodily needs 


78 


1.9 


41 


18 


8 


time - o 


240 


2.0 


121 


26 


9 


space 


446 


2.1 

or 


209 


29 


10 


qua ntity 


276 


2.3 


115 


. 3p 


*11 


ideational process 


286 


1.6 


172 


20 


12 


affection 


0 


- 


0 


0 


13 


fears ' 


4 


2.0 


2 


6 


14 


good 


15 


5.0 


3 


. . 5 


15 


bad 


16 


16,0 


1 


5 


16 


superego words or authority, 
"ought words" 


9 


2.3 


4 


6 


17 


act of oral communication 


56 


2.9 


19 


19 


18 


effort and activity 


128 


1.7 


75 


20 


19 


physical movement 


349 


2.1 


162 


68 


20 


recreation 


111 


1.6 


69 


25 


21 


family and home environment 


132 


1=.6 


80 


36 


22 


male 


91 


1.2 


70 


10 


23 


female 


9 


.5 


18 


8 


. 24 


negative words 


169 


2.0 


84 . 


19 


25 


affirmation 


47 


2.9 


16 


6 


26 


• animals 


17 . 


2.1 


8 


21 


27 


questions asked the examiner 


84 


2.9 


29 


★ 


28 


questions asked by the 
examiner 

« 


. 642 


1.1 


599 


P 


29 


indistinguishable sounds 


191 


2.2 


.85 


3 


30 


jsounds 


233 


1.6 


147 


7 
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plujfH; of the analysis . In order to reduce the fatigue factor, the pages of the 
list of words were arranged according to a generated table of random numbers . 

and 'split into halves. Each psychologist received one-half of a list of words, 

# ^ - _ 

which he was instructed to assign to a 1 * many as three of the 26 categories. 

Each word received five judgments as to its psycho-social meaning. If three of 

% 

ry-T . 

the five judges agreed the word was representative of d category, the word ^ 

* t • ~ 

was so tagged and included in the dictionary. Before the final computer analysis, 

ip 

the investigator included four more variables he judged important in the language 

of children (Table 1, numbers 27-30). 

% 

The resulting dictionary was used to study the sex differences in the 

/ 

t 9 • i 

language of children. The computer program used in this comparison calculated . 
the mean length of response and the' type -token ratfo for each group as well 

* . . - rJL 

as the relative frequencies of the 30 content analysis categories. 

i r * 

4 / 

The concurrent validity of the procedure of assigning tags to words out 

of context for future analysis of material in context was established by another 

* * . « 

judge who had not previously participated in the study. The judge, a kinder- 
garten. teacher with seven years of teaching experience, analyzed the content 

f 

of a language sample. of ten randomly selected subjects. She was given a 
list of the 30 categories to be used in analyses along with instructions to 

v 

count the .number of times each category Appeared in the text. The procedure 
was repeated with the same sample after* a six hour rest period. A Pearson 
product-moment coefficient of correlation was computed to determine the scorer's 
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The some sample of language wnr» analyzed by the computer using the 

dictionary compiled in this study. The intorcorre lotions for the three judgments 

, % 

on the 30 categories (N=30) were computed to determine the amount of agree- 
ment between the human judge and the machine. . , 

* * 

Results ^ - 

% 

Of the 747 words submitted to the judges, only 22 were found to represent 

two psycho-social variables. The third column in Table 1 lists the frequency 

* * * 

of^fceurrcnce of each tag in the dictionary The symbols next to categories 

« 

27 and 28 resulted from the peculiar nature of these categories. These symbols 

» • t 

were used in the text to indicate the occurrence of a question. The frequency 
of occurrence was the sum of the frequency for boys and girls. 

. The relative frequencies for boys and girls in all the categories are listed 
in columns 1 and 3 of Table 1. 




A Spearman rank order coefficent of correlation was computed for the two 
groups using the categories as subjects. It was found to be .77. This indicated 

that differences did exist between boys and girls with regard to frequency of 

* * 

references to categories. In order to determine the categories which caused 

^ •* • 

• o 

the reduction of the Spearman rank order coefficient of correlation, a ratio number 

was computed for the number of boys' references to a category as compared to 

£ 

girl£ references to the same category. If it differed from the ratio of 1.6 for 

, 

the entire sample by an absolute value of *.5 it was considered to have reduced 
the Spearman j\ This ratio, reported as the index-number in Table 1, indicated 

• * t * 

that boys had proportionately more references to aggressiop, space, quantity', 






<!v 



good, bad, authority, physical movement, and affirmation and asked the examiner 

.a . 

** * y 

more questions than the girls did. The girls had more references to' the female 

*3 * 

role and required more questions by the examiner to elicit the language sample. 

\ • • 

4 

» 

Finally, boys made more indistinguishable sounds than the girls made. The 

/ ' J? 

psychological significance of these differences was discussed by Sause and 

* * 

♦ 

*> V 

Gunning (19G9) and Sause (1970). 

^ * 

Table 2 shows the results of a^t test for the significance of the difference 
between the m^StKword length of independent samples and a Jt test for the signi- 
ficance of the difference between proportions. 



(Insert Table 2 ^bout Here) 

V * 

The results indicated no Significant sex differences in the length or variety of 

* 0 * 

response for boys and .girls. This result did not concur with the general opin- 

♦ 

ion of researchers in the field (McCarthy, 1953). 

- • * «■ , 

** * 

Table 3 lists the coefficients of correlation for the test-retest reliability 

of the human scorer and the concurrent validity of the Computer content analysis 

/' 

• * <£- 

technique developed in this study with the hand content analysis. 

(Insert Table 3 About Here) 

\ 

Although the heterogeneity of the scores brings the coefficients of corre- 

i * 

lation very near the perfect correlation of 1.000^, it was found that the human 

u 

judge working with words in context and.thd computer working with empirically 
togged words out of context scored the frequency of occurrence of the 30 content 
analysis categories identically. 
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Table 2 . 

, ’ / S 

The Results of Tests of Significant Differences between' 
Boys and Girls in Mean Length* of ResjSldftse and Type^Token Ratio 



1 


N 


X No.. of Words . 


4 

/ ; 

S. D.. 


4 

_t for Wbrds 


•$TR 


•i for TTR 


Boys 

Girls 


81 

63 


204.1 • 

163.2 . 


133,1 

125.8 
-V — 1 


1 .87 - 

• ^ , 

4 ’ • 


.13 ’ 
.10 


r * 

..33 

* 

v * s. 

✓ 



•Table .3 



Coefficients of Correlation for the Relationships 
Between Computer and Hand Consent Analysis . 
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• 4 * Conclusions and Discussions „ 

* • 

# 

It Was concluded that a computer con use an. empirically constructed • 

♦ ' • » # 

dictionary to perform rapid content analysis of words out of context almost os 
well os o human judge con working with the categories and the words in context 

V * ’ _ . 

The difference observed in the psycliologicol and social factors present 

4 

fn the oral language of boys and girls seemed to concur With the roles expected 

I 1 

I * p # 

of the two groups in western society. • . 

- The language indicated that the boys were more aggressive and more in- 

« • * ' 1 J fc ’ ' 

\ 

tercstcd in eva lie tion of behavior (good, bad, authority). This followed from • 

* » 

the fact that more aggressive people are often subjected to more active re- 
strictions on their behavior by society than the passive conformist. .In orde\’ 

I 

* 

to avoid .conflict the boys wanted to know more about the situation so they 



ask£d more questions and made more affirmations than the girls did. As was 

’* r 

expected, the boys were also more interested In quantity,- space, physical 



activity, "and animals. ^ • 

‘ The girls/ on the other hand, were more passive, made more references * 



to the female role #< and required more quegj^ans to elicifee verbal response than # 



the boys did.. 



V 



/ 



' The Conclusion of this study was that it was possible to identify by cpmpi 

fV - ‘ 

Content analysis factors .irt the veilsal behavior of groups of kindergarten childre 



The information gained bjfhis proci^ure was previously only available by very . 

\ * * / - \ * 






slow, very expensive ^rojdcti^t^fechniques. It was now possible to measure 

1 



» s 



behavioral change in groups of students by the content analysis of samples ofv^ 

• * S * ♦ 

* e 0 ' * 1 

their ycrbal behavior. Tho^c^proccdulGs used equipment available to many 



researchers in the area of child development. 

s ^ . i 
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RECOMMENDATIONS 
" " 1 * ' _ * 

. * . 1 

\ 

It*is recommended that: 

- > * 

* 1 . Those techniques be used in a cross-sectional or longitudinal study 

■ • 

* • * 
k • * 

* of the development of psychological and social factors in the language 

of children. ‘ 

2. ^/ Other investigators examining psychological and social variables 
use this technique to test their hypotheses . 

r 

3. These techniques be used to evaluate the effectiveness of non- 
• ‘ cognitive objectives df curriculum-materials. 
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